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COMMENTS  ON  PRESENTATION  BY  PAUL  COX 


H.  L.  Lucas 
Institute  of  Statistics 
North  Carolina  State  College 
Raleigh,  North  Carolina 

The  panelists  so  far  have  covered  just  about  everything  that  I had  in 
mind.  I certainly  agree  in  the  main  with  the  comments  they  have  made 
regarding  just  what  particular  points  on  the  observed  curve  or  what  parti- 
cular function  of  the  observations  may  be  of  interest.  Also,  I agree  with 
the  comments  regarding  the  desirability  of  fitting  a " rational"  model, 
which  presumably  can  be  supplied,  at  least  in  approximate  form,  by  the 
engineers.  I wish,  however  to  expand  on  a very  important  point. 

Many  of  the  remarks  of  panelists  about  design  and  analysis  have  been 
engendered  by  the  existence  of  "noise"  along  the  curve  for  an  individual 
motor  and  the  probable  lack  of  independence  of  successive  observations. 

I wish  to  emphasize  that  there  is  another,  and  probably  much  more  import- 
ant, "noise"  component  involved.  The  latter  arises  from  the  fact  that  a 
group  of  motors  which  are  constructed  and  treated  alike,  insofar  as  can  be 
managed,  will,  nevertheless,  have  inherently  somewhat  different  curves. 
That  is,  there  is  "between-motor"  noise  as  well  as  "within -motor"  (along - 
the-curve)  noise.  The  existence  of  between-motor  noise  must  be  taken 
into  account  for  proper  experiment  design  and  analysis. 

It  is  instructive  to  formalize  the  situation  in  a way  which  encompases 
the  two  noise  components.  For  the  jth  experimental  unit  (here  the  motor, 
but  in  other  cases  a machine  or  an  animal,  etc.  ) on  the  ith  treatment,  we 
can  write  the  model, 


(i) 


yij(t)  = ‘M*:  §_ij)  + 


where 


y..(t)  = observed  time  curve  for  the  unit 
ij 

d> (t ; 0 . . ) = "true"  time  curve  for  the  unit 
— ij 

0..  = vector  of  parameters  for  the  unit 
-ij 


€..(t)  = "within -unit"  noise, 
U 
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For  the  jth  unit  on  the  ith  treatment,  we  next  write 


(2) 


e . . = e*  + 6 

— ij  “1  — ij 


where 


0 = expected  value  of  0 . . for  units  on  the  ith  treatment 

1 r -ij 

6 = "between-unit"  noise, 

ij 


Substituting  (2)  into  (1)  yields  the  model  desired,  namely, 


(3) 


VyW  = 4>[t;(§*  + 6..)]  +«y(t). 


that 


Suppose  we  compute  0.., 


an  estimate  of  0,.,  for  each  unit, 
“ij 


We  see 


(4) 


e ..  = e ..  + )v. 

-ij  -**j 


where 


h..  = *?lt;  0..;  , a vector  of  errors  with  which  0 . . is  estimated: 

-nj  “ij  ij  J -ij 

thes'e  stem. from  "within -unit"  noise. 


* 

We  are  interested,  however,  in  estimating  0.. 
can  be  seen  by  substituting  (2)  into  (4)  to  obtain 


The  relation  of 


A * 

0 . . to  0 . 
-ij  i 


A * 

0 ..  = 0 . + 6..  + *».. 

— ij  —l  — ij  -hj 


* 

= 0 . +6.. 

-i  ij 


% 


(5) 
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Note  that  6..  =6..  +’77.,  is  the  total  noise  or  error  in  6.  and  stems  from 
— ij  -ij  t-ij  — aj 

both  "between"  and  "within"  noise. 


In  view  of  the  development  just  completed,  it  is  certainly  reasonable 
first  to  estimate  0_„  for  each  individual  unit  and  then  as  a second  step,  to 

analyze  the  . according  as  the  experimental  design  dictates.  Since  -0 
XJ  —ij 

is  a vector,  multivariate  methods  may  be  desired.  Note  that  the  procedure 
is  a "robust"  one. 


, Some  papers  in  which  the  "robust"  approach  has  been  employed  are 

fil  [3],  [4  [5l  [6], 

In  view  of  the  remarks  of  some  of  the  other  panelists  about  choice  of 
points  along  the  time  curve  and  about  correlation  between  successive 
observations  along  the  curve,  the  following  comments  seem  in  order.  In 
my  experience,  the  contribution  of  the  "between"  noise  6 to  the 

a * _ij’ 

variance  of  0..  as  an  estimate  of  0 . is  dominant  over  the  contribution  of 

— Xj  _x 

the  "within"  noise  as  summed  up  in  . In  fact,  in  some  instances,  the 

"between"  noise,  6_. .,  is  large  relative  to  the  "within"  noise,  e..(t), 

itself;  in  this  event,  the  contribution  of  h.,  is  negligible.  With  6 

“HiJ  — ij 

dominant  over  it  is  clear  that  one  need  not  worry  much  about  the 

correlation  between  successive  observations  on  the  same  unit,  that  any 
reasonable  method  of  computing  j). . will  do,  and  that  one  needs  use  only 


..th 


the  minimum  number  of  points  along  the  ij  curve  consistent  with  the 
complexity  of  <j>  and  the  obtaining  of  moderately  efficient  estimates  of  0... 


-ij 


This  leads  next  to  the  design  problem,  a matter  which  has  been  dis- 
cussed by  the  other  panelists  primarily  from  the  standpoint  of  selecting 
points  along  the  time  curve.  In  view  of  my  foregoing  remarks,  I cannot 
see  that  the  pattern  for  selection  of  points  along  the  time  curve  is  the 
really  critical  matter,  just  as  long  as  the  pattern  is  a reasonable  one. 
Instead,  the  important  question  is  how  to  select  an  optimum  set  of  treat- 
ment combinations. 


To  comment  further  about  the  design^problem,  it  is  again  advantageous 
to  be  somewhat  formal.  We  note  that  0 . is  a function  of  the  levels  of  the 
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treatment  variables  (here,  temperature  and  mixture);  i.e.  , 


L,  = £(*; ; a) 

— i —i  — 


where 


v = a vector  of  functions  of  the  vectors  x.  and  a 

. — l — 

x.  = tl^e  vector  of  levels  of  the  treatment  variables  characterizing  the 
i treatment; 

a = a vector  of  parameters  which  depends  on  basic  invariants  and  on 
the  levels  maintained  for  treatment-type  factors  not  under  study 
(i.  e.  , factors  held  constant  over  all  i). 

Substituting  (6)  into  (5)  yields 


0 . . = y(x.;  a)  + ft..  , 

—11  — —l  — ' 


Now,  if  the  functioned  forms  represented  by  are  known,  the  problem  is 
to  select  a minimum  optimal  set  of  x-vectors  such  that  all  elements  of  a 
can  be  estimated  and  that  the  estimate,  ‘a,  is  "best"  in  a suitable  sense. 
In  general  the  optimum  design  depends  on  a,  but,  since  a is  unknown, 
one  must  use  previous  estimates  (or  best  guesses)  about  a in  order  to 
arrive  at  a good  design.  Some  ideas  about  this  problem  are  given  in  1 2 [. 

If  the  forms  of  the  functions,  y_,  are  subject  to  question,  the  design  must 
have  extra  x-vectors  so  that  tests  about  the  assumed  y and  insight  about 
improvements  can  be  obtained.  The  latter  point  is  also  discussed  briefly 
in  |2]. 

I have  finished  the  main  things  I want  to  say.  There  are,  however, 
a couple  of  other  matters  that  come  to  mind. 


The  first  has  to  do  essentially  with  what  function  of  <f>  and  hence  of 
y..(t)  is  really  of  concern  to  the  investigator.  Although,  in  some  instances, 

only  a particular  univariate  function  of  «{>  may  ever  be  of  interest,  my 
experience  indicates  that  this  is  not  generally  true.  I suggest,  therefore^ 
that  ordinarily  it  will  be  best  to  study  4> ; i.  e.  , to  fit  the  parameters,  0 . , 


77 


Design  of  Experiments 

or  more  basically,  a.  Given  such  fits,  anything  desired  can  be  ascertained. 

Finally,  in  the  first  analysis  Mr.  Cox  outlined,  he  failed  to  distinguish 
'‘between1*  and  "within"  noise.  The  variance  sources  for  his  analysis  were 

Treatment 

Time 

Time  by  treatment 
Residual  * 


They  should  have  been 


Treatment 

/ v 

Motor  within  treatment  (Error  for  treatment;  corresponds  to  6 

ij 

Time 

Time  by  treatment 

Time  by  motor  within  treatment  (Error  for  time  and  time  by  treatment; 
coresponds  to 


In  closing,  I should  note  that  Mr.  Cox,  in  all  but  his  first  analysis, 
adopted  the  "robust"  approach.  I stress  the  approach,  however,  because 
it  is  important,  and  because  judging  from  his  first  analysis,  Mr.  Cox 
appeared  not  to  be  very  clear  on  the  implications  of  the  existence  of  both 
"between"  and  "within"  noise. 
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